💻 Local LLMs - nmarshall · Scour

Quantization, LoRA, and the 8% Problem: Benchmarking Local LLMs for Production AI 📱Edge AI

walsenburgtech.com·3d·Hacker News

One Layer, +12%: What 667 Configs Reveal About Small LLM Anatomy 🏗Computer Architecture

austinsnerdythings.com·6h·Hacker News

amitshekhariitbhu/llm-internals: Learn LLM internals step by step - from tokenization to attention to inference optimization. 🤖Transformers

github.com·1d·Hacker News

Self-Hosted AI on a 24GB GPU: OpenClaw + Ollama Setup Guide for Windows ☁️Serverless Rust

blog.zolty.systems·11h

One tiny change made my local LLMs more useful than ChatGPT for real work 🏠Self-hosted AI

xda-developers.com·2d

Completely Private AI 🏠Self-hosted AI

molebieai.com·6d·Hacker News

Talking to a local LLM in the Firefox sidebar 🎙️Whisper

code.mendhak.com·19h·Hacker News

Qwen 3.5 397B on a MacBook @ 29 tokens 🔵Unikernels

dotkam.com·1d

Multi-agent AI orchestration built for governance, in Rust 🤖AI agents

broodlink.ai·13h·Hacker News

EU's Exposed AI Infrastructure 🏠Self-hosted AI

insecurestack.substack.com·6d·Substack

Episode VII of Phase One: Skills, agentic workflows, and the tinker's burden 🤖AI Coding Tools

passo.uno·1d

g1ibby/llm-deploy: Tool to manage ollama model on vast.ai 🚀MLOps

github.com·17h

Free Gemma 4 Chat, Setup Guides, and Model Comparisons 📈Grafana

avenchat.com·2d·Hacker News

Structural and semantic component for improving code reviews with local models 🔍Code Review

news.ycombinator.com·6d·Hacker News

Ollama is still the easiest way to start local LLMs, but it's the worst way to keep running them ☁️Serverless Rust

xda-developers.com·6d

aweussom/NoLlama: NPU Ollama - An Ollama/OpenAI compatible API for Intel OpenVINO compatible computers 🔵Unikernels

github.com·2d·Hacker News

Running GLM-5.1 (744B) Locally on a Mac Studio: Benchmark Results ⚙️Performance Profiling

blog.zolty.systems·1d

adityaarakeri/llmscan: A fast CLI that scans your hardware and tells you which local LLMs will actually run on your machine. 🚀MLOps

github.com·6d·Hacker News

mahadillahm4di-cyber/mh-gdpr-ai.eu-s-plus: Switch GPT ↔ Claude ↔ Llama, never lose context. Your AI brain as 3D stars. 100% local — your memory belongs to you, not to OpenAI. 🤖Anthropic Claude

github.com·6d·Hacker News

m4cd4r4/claude-echoes: Verbatim semantic memory across Claude Code sessions - pgvector + local Ollama embeddings ⚙️Zig

github.com·5d·Hacker News

No more posts from nmarshall's subscribed feeds.

Scour all 23985 feeds Learn more about Feeds